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ABSTRACT 

This document discusses the need to control 
curriculum quality and describes two methods to assess school 
districts 8 efforts at curriculum quality control, Exercisiag such 
control means effecting a congruence between what should be taught 
(the school districts objectives), what is taught, and what students 
learn. In the first method of assessing curriculum quality control, 
the school district looks at its own curricular documents, using the 
following criteria; clarity and validity of objectives; compatibility 
between curricular objectives and testing measures; clarity of ttie 
grade-by-grade sequence of objectives and of the description of major 
instructional tools; and curricular adaptability to classroom usa. In 
the second method, called the Educational Performance Audit, 
independent auditors gather data from school visits and interviews as 
well as curricular documents. The auditors then assess curriculum 
quality control according to whether a district (1) can demonstrate 
control of resources, programs, and personnel; (2) has measurable and 
valid objectives; (3) has documentation explaining program 
development, implementation, and conduct; (4) uses results from its 
own assessments to correct ineffective programs; and (5) has improved 
"productivity" (the level of pupil achievement) * The document also 
suggests steps for citizens to take and barriers to overcome in 
improving their schools* curriculum management. (RW) 
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FOREWORD 



When the effectiveness of schools is questioned as 
Y:idely as it has been questioned recently, there is some 
assurance in studies that identify characteristics com- 
mon among schools where teaching and learning go de- 
pendably forward. Thanks to the enterprise of research- 
ers on both sides of the Atlantic, we now have a pretty 
clear idea of what those characteristics are. Good teach- 
ing and sound learning depend not s:: much on condi- 
tions that often draw attention — bu„ding design and 
age, school organization, school and c_ass size, ere. The 
conditions that make important differences in schools 
are the instructional leadership of principals, definition 
of purpose, expectations of students, time spent "on 
task," and others. 

Lacking still, however, is much knowledge of how to 
bring such conditions about where they are not already 
pn sent. It is sometimes difficult even to determine to 
what degree they are present or absent. For a certainty, 
replacing poor conditions of instruction and learning 
with good is never easy. Money cannot buy a quick fix, 
because there is no such thing. 

' he procedure Fenwick English explains in this Occa- 
sional Paper is the kind of strenuous exercise CBE be- 
lieves school improvement requires. We like the idea 
because it makes curriculum central; and while some 
business methods may not fit education, this scheme for 
"quality control" of curriculum deserves careful consid- 
eration. 

For many years on the front lines in education as 
schoolteacher, principal and superintendent, Fenwick 
W, English now works for Peat, Marwick, Mitchell & 
Co., a national accounting and consulting firm with spe- 
cial expertise in educational institutions. Mr, English is 
National Practice Director of PMM's Elementary and 
Secondary Education Consulting. 

James Howard 
Director of Publications, CBE 
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I. Curriculum and Management 



What Is Curriculum? 

A curriculum is an amalgam of decisions that estab- 
lishes a pattern of response to recurring circumstances 
within schools. A curriculum comes into being when 
someone decides what will be learned, how much time 
will be spent, and what order will be followed. Even a 
decision to ignore these matters is a decision, but then 
decision is given over to students by default. 

A classroom curriculum -an be as simple as construct- 
ing a required reading list (what will be learned), de- 
termining the time to be spent on each book (the empha- 
sis), and the order in which :he books will be -ead (the 
sequence). Such a reading list represents one kind of 
curriculum. 

Why Management? 

Management is practice. Its essence is not knowing but 
doing. Its test is not logic but results. Its only authority is 
performance. 1 

Peter Drucker's concise definition of management has 
never been more important to schools than now. Declin- 
ing test performance by students, passage of minimum 
competency laws, decreasing public confidence in the 
schools, shrinking tax support, voucher plans, and bank- 
rupt city school systems attest to the dismaying condi- 
tion of public schooling. 

The public has become skeptical of pleas from educa- 
tors to increase the financial support of schools in the 
thin hope that all will be well. No one believes that de- 
ficiencies in schooling are totally the fault of students or 
of society. 

How can the schools become more responsive to pub- 
lic demands and more effective institutions of learning? 
What can citizens, teachers, parents, and administrators 
do to improve the quality of schooling? Answers to 
these pressing questions call for more than helping one 



teacher in one classroom, altho,: : -it is the core of the 
enterprise. The task of managers: .s to generalize ef- 
fective performance. The relation; / 3 between individ- 
ual classrooms, schools, and schc. -/stems are the re- 
sponsibility of management, Nt Lament is concerned 
not only with the individual pa _e system but also 
with how they work together as . ::m. 

Curriculum As a Management j^citit 

A curriculum is one method _ an^ure that the objec- 
tives set by legitimate educational authorities are 
realized. No curriculum would :s recuired for schools if 
any result or outcome were as gcoc as any other, or if 
the state had not decided that fern- results are clearly 
more important than others. Ir. snort, a curriculum is a 
management tool. 

A curriculum draws the boundary of what is meant by 
schooling. It defines the territory in one of two ways. 
One way defines curriculum as the means to attain 
specified objectives. 2 Another way defines curriculum as 
all teaching and learning tha; may go on in school, 
planned or unplanned. 

in the first instance, a curriculum is specific and lim- 
ited. In the second, it is a spcnge, seeing up all it can 
hold from a sea of activity. The function of the latter is 
to contain all possible events; its principal characteristic 
is flexibility.* Educators like to amplify this idea with 
talk about accommodating "individual differences/' 
"teaching to the pupil's needs," "facilitating the devel- 
opment of attitudes for productive citizenship in democ- 
racy," and "mediating the interpersonal interests and 
abilities so that maximum potential is attained," Plainly, 
the second definition is contradictory; a boundary with- 
out limit — a curriculum without purpose — is not a 
curriculum at all. 

Teachers tend to prefer curricula that least impair 
their control of classroom activities. Sociologist Dan C, 
Lortie describes the persistent discontinuity between 
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school-system objectives and teacher objectives: "Offi- 
cial statements of school objectives and the daily reality 
of classroom teaching are not the same thing." 4 To as- 
sure reasonable uniformity of results, however, a school 
system requires some consistency among classrooms in 
order to guarantee pupil learning to a demanding pub- 
lic. 

Lortie attributes the problem to the "cellular organi- 
zation" of the schools which isolates teachers, causes 
high turnover, and precludes "any important gains in 
teacher productivity/' 5 It also leaves teachers unac- 
countable for their choices. 6 Because curricular am- 
biguity is so prized by teachers, preserving it is a politi- 
cal issue that affects curriculum management. 

A school district wanting a curriculum that specifies 
important skills, knowledge, and attitudes to be taught 
and learned may find itself distracted by proposed goals 
and objectives that are too vague. Drucker argues that 
objectives should be specific and operational; that is, 
They must be capable of being converted into specific 
targets and spr "fie assignments. . . . They must winnow 
out the fundamentals ... so that the key resources of 
men, money, and physical facilities can be concentrated. 
They must, therefore, be selective rather than encompass 
everything. 7 

The political issue can be framed as follows: under 
what conditions and ground rules should teachers, 
supervisors, and policymakers share in decisions about 
curriculum? Leaving the issue hanging will render a 
school system powerless to bring about instructional 
improvements, given the complications of managing 
multi-year schooling for many students with many 
teachers who may interpret curricular goals differently 
and who work essentially in isolation from their col- 
leagues and the system itself. 8 

Means vs. Ends 

A common flaw in curriculum management is the 
substitution of means for ends; that is, what teachers do 
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instead of what pupils learn. For example, consider this 
objective: "Assist each pupil in learning how to write 
clear, logical sentences." It sounds good. What it points 
to, however, is the teacher's assistance and not the 
pupil's mastery. The objective should be rephrased: 
"The student will be able to write clear, logical sen- 
tences." 

Other examples of substituting teacher behavioi for 
pupil learning are shown below: 



Objective 



To encourage desirable pupil 
mastery of initial consonants l.r, 
and s blends. 



To provide an understanding of 
Spartan culture and other 
militaristic societies in order to 
find similar governmental struc- 
tures in today's world. 

To recognize that students enter 
ths classroom with various de- 
grees of knowledge about the 
mechanical conventions of punc- 
tuation, capitalization, and 
indentation. 



What May Be Measured 



The teacher's "encouragement" 
(whatever form that may taJce) 
and not pupil mastei-y of initial 
consonants. 

The teacher's "provision" (in 
whatever form it may take) and 
not the pupil's grasp of Spartan 
culture. 



The teacher's "recognition" of 
student differences and not the 
differing levels of student mas- 
tery of the mechanical conven- 
tions. 



Parents, citizens, teachers, and administrators should 
study the curricular documents of their school systems. 
Criteria for evaluating these documents will be pre- 
sented in a later section, Properly drawn, specific objec- 
tives are critical to successful curriculum management. 

Content, Priorities, and Sequence 

A curriculum reflects decisions on what should be 
taught, what should be stressed, and what sequences 
should be followed. Such decisic ; occur at two levels 
of curriculum management. 

5 
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The first level is inhabited by state legislatures and 
boards of education. Their decisions on what should be 
taught usually take the form of broadly stated goals, al- 
though there has been a receni trend toward mandating 
specific curricular objectives or competencies. In gen- 
eral, however, these first-level statements are not part of 
the curriculum as the term is popularly used; rather, 
they indicate the more general purposes for which the 
curriculum is *he means of attainment. 

Second-level curricular decisions are usually made by 
local boards of education and are more specific; these set 
the objectives that affect classroom instruction. For 
example, a curricular objective at the local level might 
have all students "learn to balance a checkbook" as part 
of a. more general mandate requiring each student to 
master basic arithmetic. The particular objective might 
be located within the curriculum of mathematics, home 
economics, economics, or perhaps another subject. 

After the adoption of goals by a state legislature or a 
curriculum by a locr.l board of education, the same 
bodies should establish priorities. These will tell school 
professionals and the public what is more important, in 
the view of the policymakers, and what is le^s. Explicit 
priorities inform school administrators and teachers 
where their priorities should be set. Loosely defined 
priorities enable supervisors and teachers to stress their 
own, which may or may not be what the policymakers 
intended. Vague priorities give the appearance of 
legitimacy by allowing conflicting interpretations and 
thus make good management almost impossible. Ac- 
countability requires well-defined objectives and 
priorities. Without them, citizens have no basis for 
critiquing the schools, and school boards often find 
themselves trapped into programs that they had no de- 
sir? to commission. 

A third kind of decision leads to curricular sequence, 
the order in which the content is to be learned. Educa- 
tors disagree over the value of sequence in the cur- 
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riculum. Some argue that sequence is a subjective de- 
termination and that research fails to show any consis- 
tent correlation between sequence and pupil achieve- 
ment. For them, any sequence is as good as any other. 
Unfortunately, the debate sometimes obscures two sa- 
lient points. First, some rational sequence is needed 
when the acquisition of skills or knowledge depends on 
prior learning, as, for example, in mathematics. In addi- 
tion, a sequence is necessary for gathering systematic 
data about pupil learning. 

Suppose, for example, that a teacher gives a diagnostic 
reading test to fifth graders and finds that several do not 
know vowel digraphs (oy, oi, ow, etc.). The teacher or- 
ganizes a small remedial group, and the students master 
vowel digraphs. Suppose a different teacher encounters 
students who do not know vowel digraphs, but this one 
raises the problem with fellow teachers. Together they 
decide that vowel digraphs should be taught in the sec- 
ond grade so that fifth grade teachers needn't create re- 
medial groups. In practice, however, vowel digraphs can 
be taught anywhere in the curriculum. What if a teacher 
decides not to teach them? It is the curriculum that fixes 
the responsibility of teaching vowel digraphs in the sec- 
ond grade, not elsewhere. 

In this way, the curriculum performs a management 
function by defining the content, emphasis, and se- 
quence of learning. It does so in the interest of economy 
of teacher time, pupil time, and other school resources, 
all of which are limited. 



II. Curricular Assessment 

Testing and the Curriculum , 

It may surprise many citizens that most school dis- 
tricts cannot state the extent to which the standardized 
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tests used in their schools assess the curriculum.* The 
divorce between testing and curriculum may be one rea- 
son many districts oppose increased testing. It is also 
why teacher antipathy towards testing is usually mili- 
tant. Most teachers have never learned to use test results 
and relate them to their own teaching objectives. Ordi- 
narily, standardized test questions are considerably 
more definitive than most classroom teaching objectives. 
Furthermore, when the curriculum is so vague that 
teachers can do most anything, standardized tests exert a 
kind of control not sensed from other quarters. 

These comments are intended not to defend stan- 
dardized testing but to describe the inability of teachers 
and administrators to see much value in test data when 
the information appears so unrelated to their other ac- 
tivities. r pp_':hers resent the control that testing appears 
to impose and they see constraint on the curriculum as 
an improper function of testing. 

Standardized tests should not define the curriculum. 
They should be used to assess whether students have 
accomplished the objectives of the curriculum. It is un- 
deniable, however, that tests have become the cur- 
riculum in some instances. That is, instead of an elected 
or appointed board of education defining a curriculum 
with locally adopted objectives, a test publisher elected 
by no one defines the curriculum and the objectives. 

In short, a school district should know how well a par- 
ticular test matches its curriculum. The curriculum 
should state precisely what students are expected to 
learn, and the testing program should be aligned to the 
objectives. When test data are obtained, then the district 
has the capability to make adjustments among all three 
elements (objectives, teaching, and testing) to improve 
pupil achievement. 

* A standardized test may be norm-referenced, which compares 
pupils against other same-aged pupils in a representative sample, or 
criterion-referenced, which compares pupils against pre-set stan- 
dards of knowledge or skill. 
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The Concept of Curricular Congruence 

To manage a curriculum well means effecting a 
planned and systematic congruence or "match" between 
(1) what the teacher does teach, (2) what the teacher 
should teach, and (3) what students actually learn. 

Figure 1 depicts how these three elements are inte- 
grated into one coordinated activity. Congruence is the 
term for the ability of a school district to define, estab- 
lish, and maintain integration among all three, a func- 
tion of management called quality control. 

If a school district knows (a) what it wants to ac- 
complish, (b) how to perform as required, (c) how to as- 
sess the results, and (d) how to make adjustments so that 
a greater proportion of the results are attained, it knows 
how to exercise quality control. 9 When it knows how to 
do this consistently without using more resources (time, 
money, and materials), it is capable of becoming more 
productive. 10 




Good quality control enables a school district, school, 
or teacher to narrow the gap between desired and actual 
pupil learning. Obviously, an assessment of quality con- 
trol cannot be precise; it has to be judged in relation to 
the situation and the resources available. 
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The variables that schools can control tc aake a dif- 
ference in what pupils learn are: what teach ;:s choose to 
teach, how much time they spend teaching it, and the 
order of the things taught. 12 Educational researchers 
have lumped the first two variables togeth- ; and dubbed 
them time on task. 13 

Table A gives an example of determinb g one type of 
curricular congruence. The table compares objectives set 
by a board of education for various subjects to the per- 
centage of pupils at a hypothetical high school affected 
by the various subjects in four years. 

Table A 

Hypothetical Congruence Between a Board's 

Objectives and Subjects; 
Percentage of Pupils Affected in Four Years 
of High School 



Subject Congruence Percentage 

with Board's of Students 
Objectives Affected 



1. History* 


16% 


73% 


2. Mathematics* 


8% 


50% 


3. English/Composition* 


23% 


84% 


4. Science* 


4% 


61% 


5. Vocational education 


74% 


13% 


6. Physical education 


19% 


98% 


7. Foreign language 


3% 


11% 


8. Health 


6% 


39% 


9. Music 


2% 


18% 


10. Art 


1% 


8% 


* Board priority area 







The table indicates that the best match between the 
board's objectives and any subject occurred in voca- 
tional education (74 percent), followed by English/ 
Composition (23 percent), physical education (19 per- 
cent), and history (16 percent). Yet vocational education 
in this high school affected only 13 percent of the stu- 
dents over four years, while the other three subjects af- 
fected nearly all students. 



There was only a 16 percent congruence between the 
board's history objectives and the history curriculum. 
This means that 84 percent of the history curculum 
was not accounted for in objectives that affected 73 per- 
cent of the students, a striking example of what is called 
slack. The lack of congruence ought to promr i several 
questions. What makes up the 84 percent? Is h siory se- 
quential or merely a potpourri of mini-courses How is 
the history curriculum defined? Who is accoun able if it 
is not effective? How is its effectiveness judged? 

Classifying a school board's objectives by assigning 
them to the various subjects helps to understand the rel- 
ative importance of each objective and raises questions 
about how the board indicates its priorities to the pro- 
fessional staff. Lack of congruence is not a bad quality 
by definition; indeed, it identifies fractions of the cur- 
riculum that are unaccounted for. 

In the example shown in Table A, the board's objec- 
tives may be overbalanced in favor of vocational educa- 
tion. Other subjects may require more emphasis. Math- 
ematics and science, for example, are designated as 
priority subjects but have only 8 percent and 4 percent 
match with the curriculum, respectively. Or the board 
may wish to establish new priorities in music and art; by 
altering the curricular requirements, the percentage of 
students affected can be increased. 

Criteria for Judging Curricular Congruence and Quality 
Control 

There are ways that curricular congruence can be as- 
sayed. A school district should start by reviewing all its 
curricular documents. 

The tripartite elements of quality control were illus- 
trated in Figure 1. Curricular documents should describe 
all three components and explain the interrelationships 
among them. 

Criteria for judging the effectiveness of quality control 
through the use of curricular documents have been 
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developed by the author in his work for an accounting 
and management consulting firm. 

Criterion 1: Clarity and Validity 0/ Objectives. A well- 
managed school district usually has curricular docu- 
ments that indicate specific and measurable learning ob- 
jectives in each subject. The objectives are the bench- 
marks by which learning is assessed. Proper objectives 
clearly indicate what the student is expected to ac- 
complish, the instructional conditions under which the 
student is to work, and the standards of acceptable per- 
formance upon which achievement will be judged. 

Administrative records should explain the procedures 
by which objectives have come to be defined and 
adopted. What authorities were consulted? What proce- 
dures were used by the board and staff to secure com- 
munity opinion as part of setting objectives? How was 
this accomplished? Were the procedures systematic? 
Criterion 2: Match Between the Curriculum and Assess- 
ment. A well-managed school district has taken steps to 
match standardized testing to the curriculum. Every test 
question should relate to one or more learning objec- 
tives. Every objective should lead to assessment by stan- 
dardized testing or some other means. In this way, 
schools will know whether the curriculum works. Fur- 
thermore, teachers will know which objectives will be 
assessed by testing a*id which by other forms of assess- 
ment. 

The pairing of objectives and test items enables the 
staff to ascertain whether a test fairly measures what 
students have had a chance to learn in school and avoids 
testing students on subjects or skills they have not been 
taught. The development of tests should follow, not pre- 
cede, the development of objectives, or the curriculum 
may become hostage to the test. In short, the test should 
reflect the curriculum, not dictate it. 

Not all school learning is amenable to conventional 
written testing. Attitudinal objectives, for example, may 
have to be assessed subjectively by the teacher or by the 
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pupil using a self-inventory. By pairing objectives and 
test items a school should not expect to reduce all of the 
objectives to those most easily measured, but should 
come to know which parts of the curriculum are best 
assessed by what method. Most outcomes of schooling 
can be assessed, but not on a single scale and not with 
the same reliability or validity. 

Criterion 3: Definition by Grade 0/ Essential Knowledge, 
Skills, and Attitudes. A well-managed school district 
shows in its curricular documents the desired (or re- 
quired) sequence of instruction. Research does not pro- 
vide unequivocal answers to questions about how se- 
quence affects learning. Some sequential patterns are 
rather arbitrary. Nonetheless, some sequences are simply 
not as effective as others. A curricular document ought 
to acknowledge this fact where it applies and set forth 
the options that may be followed. It should also explain 
the variables and the reason that one pattern may be 
more effective than others. Variables may include the 
nature of the knowledge or skill to be learned, the back- 
ground of the learner, applicable learning theories, and 
the background of the teacher. 

Criterion 4: Description 0/ the Major Instructional Tools. 
A well-managed school district is able to show how its 
major instructional tools are related to objectives, grade 
by grade. The most common instructional tool is the 
textbook. In truth, for many school districts, textbooks 
are the only curriculum. 

Vague learning objectives encourage textbook adop- 
tions to be based on criteria such as balanced portrayal 
of the races and sexes, availability of workbooks, color- 
ful graphics, and the like. While these criteria are impor- 
tant, they may have little to do with helping students 
learn what the curriculum outlines. Unless instructional 
objectives have been made specific in the curriculum, 
textbooks cannot be selected on the basis of curricular 
match. 
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Instructional materials should be judged on their 
match with the stated and adopted instructional objec- 
tives of a school cistrict, particularly those objectives for 
each subject. MEtfi'ials that meet this standard should 
also be free of s r :st language and racial stereotypes, 
pleasant to use, i accompanied by appropriate sup- 
plements for teacr s and students. 

Criterion 5: Ado, .ability for Classroom Use. A cur- 
riculum should be easy for teachers to employ from day 
to day in the classroom. The so-called scope and se- 
quence chart, which shows grades in school and topics 
taught, is practically useless for this purpose. It arrays 
general objectives grade by grade but gives teachers no 
help in translating the guidance into action. As a result, 
teachers commonly turn to the guides that accompany 
commercial textbooks. In this way, textbooks supersede 
the board of education in setting the curriculum. 

A well-managed school district develops curricular 
materials that outline expectations and means of attain- 
ing them. Without such assistance for teachers schools 
cannot be certain that different teachers can follow a 
curriculum consistently from year to year. 

Good curricular guides are not straitjackets. They are 
not designed tc 5 ,mp out creative teaching but to en- 
sure that all teac lg i= directed toward maximum learn- 
ing in the limib i time available for schooling. Only a 
romantic would ^gue that detailed and directive guides 
are impediments to creative teaching. But creativity does 
not imply a license to do anything a teacher desires. 
Teaching should never be random or undirected. In 
classroom settings creativity is the capability of the 
teacher to produce desired learning with imagination 
and skill. 

Figure 2 summarizes all five criteria and presents a 
four-point ranking scale for use by professional educa- 
tors or citizens in examining curricular documents. 



Figure 2 

Sample Form for Rating Curricular 
Quality Control as Evidenced in 
Curricular Documents 

Rating Scale 

3 = Defined specifically 

2 = Defined generally 

1 = Defined vaguely or merely implied 

0 = Not defined 



Subject School 



Grade 

Criteria Rating 

3 2 10 Points 

1. Clarity and Validity of Objectives 
— specific and measurable pupil- 
based objectives 

— procedures used to establish va- 
lidity 

2. Match Between Curriculum and 
Assessment 

— test match, objective-by- 
objective 

— parts of the curriculum not as- 
sessed £re identified 

— assessment methods described 

3. Definition by Grade of Essential 
Knowledge, Skills, and Attitudes 
— assumed prerequisite knowl- 
edge, skills, attitudes listed by 
grade 

4. Description of the Major Instruc- 
tional Tools 

— criteria listed for textbook use 

— match between the textbook and 
curriculum, objective by objec- 
tive 

5. Adaptability for Classroom Use 

— specific examples of how to 
teach 

— interpretations of pupil re- 
sponse 
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III. An Educational Performance Audit 

A Method for Assessing Curricular Quality Control 

A recently developed method for assessing a school 
district's curricular quality control consists of an objec- 
tive, independent review of the essential components of 
curriculum management. It is called an educational per- 
formance audit, or EPA. 

An EPA can provide approximate but useful answers 
to the questions listed below: 

— Are the learning objectives adequate to guide the 
allocation of school resources? 

— How does the school district select and design 
educational programs? What criteria are used? 

— Are the existing programs the best possible re- 
sponses to the stated or assumed educational re- 
quirements? 

— What methods are used to assess students' per- 
formance? Are the methods adequate? 

— Are the existing programs working satisfactorily? 

— What methods are used to correct weaknesses in 
instruction and learning? 

— In what ways can the district become more ac- 
countable to the public? 

To embark on an EPA, a team of auditors is assembled. 
The auditors should be judged by three standards of 
qualification: authority, objectivity, and integrity. 
Educational auditors should be recognized experts in 
management, program development, curriculum, and 
assessment — preferably men and women with first- 
hand experience in managing educational programs. 
They should be capable of objective observation and re- 
porting and should have no personal or financial inter- 
est in the outcomes of the study. The integrity of an 
audit requires that the entire process, from planning to 
final report, be complete and fair, with no omissions of 
data or conclusions. An EPA stands in marked contrast 




to public relations practices that report only good news 
about school districts. 

The auditors gather data for an EPA from three basic 
source?: (1) documents (including administrative rec- 
ords and curricular guides), (2) personal interviews, and 
(3) visits to schools. The data are then compared to five 
standards that are discussed in the following para- 
graphs. 14 

Standard 1: The School District is Able to Demonstrate 
its Control of Resources, Programs, and Personnel. This 
is the most fundamental standard of an EPA. A school 
district without good control cannot assure the public of 
the proper and prudent use of its financial and human 
resources. 

Control does not mean manipulation or coercion. It 
means only that the school district is able to monitor its 
own performance against specified objectives so that it 
can make corrections whenever results deviate signifi- 
cantly from desired outcomes. A good system of internal 
control helps the staff to know what is expected, what is 
happening, how to initiate corrective action, and how to 
anticipate the consequences. A system of control ensures 
that all concerned understand the assignments of au- 
thority and responsibility. 

Standard 2: The School District Has Measurable and 
Valid Pupil Learning Objectives. Sound educational 
management also includes the development of specific 
and valid pupil learning objectives. An EPA may reveal 
crippling deficiencies in what a school district has set 
out as the major curricular objectives. 

One school system that recently commissioned an 
EPA was trying to improve overall achievement in read- 
ing and math after a protracted period of dissatisfying 
results. The board and top-level administrators believed 
that precise learning objectives would be constricting to 
the professional staff and therefore unwise, so they 
stated only general educational goals. 
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When teachers were interviewed by the auditors, they 
said that the general statements were useless and that 
they did not understand what was desired by the board. 
As a result the board had to accept almost any program 
set forth by the staff because the vague goals provided 
no criteria for judging whether the programs worked. 
From a managerial perspective, this situation: 

— prevented the board and central administration 
from being accountable to the public for specific 
learning objectives, because no specific objectives 
had been formulated; 

— made it impossible to use standardized test scores 
constructively, because testing and instruction 
were not matched; 

— excused the board and central administration from 
having to take any action in the face of evidence 
that pupils were not learning, because blame could 
be shifted easily to teachers, pupils, and parents; 

— precluded any judgments about the quality of in- 
struction in particular classrooms or schools. 

Specific objectives are essential for a school district to 
know which programs are effective and which are not. 
They are necessary as guidelines for adjusting programs, 
and they provide the basis for individualized instruc- 
tion, remediation, and the creation and evaluation of al- 
ternate programs. They are also required for setting 
priorities. 

Standard 3: The District Has Documentation Explaining 
How Its Programs Have Been Developed, Implemented, 
and Conducted. The third standard assumes that 
educational programs are combinations of resources 
(staff, time, and materials) designed to attain a measur- 
able set of outcomes of pupils. The district, therefore, 
should have data and records telling how programs were 
conceived. Records should include the overall rationale 
for decisions. The district should have a system for col- 
lecting necessary data to be used as the basis for improv- 
ing programs. 
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Adjusting a program implies attaining greater congru- 
ence among objectives, teaching, and learning and, as a 
result, increasing the level of pupil learning. For this se- 
quence to occur, the school district must be able to re- 
trieve important student information and must have ver- 
ified the validity and reliability of the data. 
Standard 4: The School District Uses the Results from 
District-Designed Assessments to Adjust, Improve, or 
Terminate Ineffective Practices or Programs. The fourth 
EPA standard helps to judge how much a school district 
actually uses information about pupil learning in mak- 
ing decisions. Decision-making should rest upon a 
well-designed longitudinal data base. To have any bene- 
fit, data must be used routinely in program development 
and evaluation. 

Standard 5: The School District Has Improved Produc- 
tivity. The idea of productivity has a special meaning for 
schools. Productivity is a measure of a district's ability 
to obtain a desired level of pupil achievement with a 
given budget. School districts can learn to increase pro- 
ductivity and to measure the change. Better productivity 
entails better congruence among the critical elements of 
schooling already described and thus, better learning 
using the same or fewer resources. 

Controlling productivity involves knowing costs and 
how to relate them to the curriculum for management 
purposes; that is, knowing what costs can be attributed 
to the curriculum and whether they can be controlled by 
the district. 

Curricular Costs: Definition and Control 

There are three kinds of costs: /ixed, variable, and 
mixed. Fixed costs are those that remained unchanged 
regardless of declining or increasing demands. For 
example, the costs of the superintendency are fixed; en- 
rollment may go up or down, but most school systems 
will still employ a superintendent. 

A variable cost is one that is directly related to 
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changing circumstances. For example, each pupil must 
have textbooks, tests, pencils, laboratory equipment, etc. 
The cost per pupil varies directly with each of these 
elements. 

Mixed costs are *hose which under certain circum- 
stances are changed, but only indirectly. Class size, foi 
example, can be called a mixed cost item in school 
budgets because the cost per pupil is not always affected 
by changes in class size. Enrollment must decrease or 
increase past certain limits before a district will either 
add or subtract staff and thus alter costs. 

When analyzing costs and productivity, the task is to 
identify the kinds of costs involved in learning and to 
understand how they may be controlled. 

The three kinds of costs (fixed, variable, and mixed) 
are subject to three variables: voJume, environment, and 
executive decisions. If too many students sign up for one 
class in Latin and extra sessions are necessary, then cur- 
ricular costs are influenced by voJume (student de- 
mand). If the community insists that Latin be offered re- 
gardless of low volume, then curriculum costs are af- 
fected by the environment. If neithei student enroll- 
ments nor community requests call for the Latin course, 
but a board of education orders it added to the cur- 
riculum., then costs are the result of an executive deci- 
sion. 

Auditing a school district for evidence of productivity 
requires an analysis of the three kinds of costs and the 
three variables that influence the costs. Such analysis 
depends on school district documents for cost account- 
ing, budgeting, and curriculum. 

An EPA is one method that a board of education, ad- 
ministration, or community may employ to assess the 
quality of curriculum management, Citizens can have 
enormous influence in the operation of a school district, 
as most experienced school leaders will testify. Their in- 
fluence can be constructive or destructive, depending 
upon their concerns and their knowledge of school 



20 



management. Their influence is unpredictable when 
they are not clear about how to control the curriculum, 
are not aware of the complexity of school management, 
or do not sustain their interest. An EPA can help to 
avoid such traps. 

Measures Citizens Should Take 

Examine ResuJts. Citizens should concentrate attention 
on the results of instruction — the amount, type, and 
improvement of student learning. Test scores are an easy 
place to begin, but always with this warning in mind: 
the scores will be useful only if there is good congru- 
ence among curriculum, instruction, and testing. Public 
consternation about low scores may pressure the school 
district into misguided emphasis on raising scores or 
may cause foolish stress on subjects that are more easily 
tested than others. 

Citizens should ask which students are actually in- 
volved in testing and which students are not. They 
should ask not only what curricular objectives a test 
assesses, but how many students took the test and where 
they stand in the class. They should ask that the district 
show how the content, emphasis, and sequence of the 
approved curriculum are being fairly and fully evalu- 
ated. 

Citizens should also ask what objectives are not as- 
sessed by standardized tests. What evidence is used by 
the staff to determine if students have learned these ob- 
jectives? Citizens should be involved in committees to 
work with the professional staff in planning test pro- 
grams and in choosing tests. Test selection, as opposed 
to test development, is not such an arcane practice that 
citizen participation must be precluded. 

Look for the Connection Between Curriculum and Instruc- 
tion. Clear objectives and gratifying test scores are not by 
themselves sufficient evidence of good curriculum 
management. Citizens should receive an accounting of the 
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managerial process. Who sets the objectives? What is the 
rationale? How are assessment results used, by whom, 
under what guidelines? What program changes have been 
made on the basis of the results? What does the staff plan to 
do if programs don't work? 

The tendency for school administrators to be evasive 
may be understandable. The problems often seem in- 
tractible and complex. On the other hand, a grant of 
latitude may obscure a failure to define a problem 
adequately or an inability to understand the relation- 
ships between curricular decisions and student learning. 

Citizens can be involved constructively in textbook 
selection, which should be coordinated with assessment 
and with the curriculum. To repeat — all three should 
be congruent. 

Citizens should examine the criteria by which 
textbooks have been selected. They should learn what 
textbooks were considered and rejected, whose expert 
opinion was consulted, and what field testing was done. 
They should guard against adopting texts solely on the 
basis of book publishers' sales pitches. Textbooks should 
be evaluated periodically for the learning they produce. 

Insist on Candid Reports, not Public Relations. Citizens 
should insist on receiving balanced reports that present 
the strengths and weaknesses of a school district. In re- 
cent times, the public relations approach that offers only 
the bright side of the news has contributed to the loss of 
public confidence in schools, particularly when test 
scores decline and other news stories indicate that some- 
thing may be seriously wrong. 

Sustain Interest. Citizen interest in the schools often 
flames up during a fresh crisis. Once the heat has cooled, 
interest may disappear and, with it, the chance for long- 
term influence on curriculum management. Sustained 
interest is important because the management of a 
school district is complex and involves many persons. 




People do not usually change long-standing habits 
without a sustained force pushing for change. In other 
words, citizens should appreciate that any substantial 
alteration in the quality of management occurs gradually 
and demands more than attending one or two meetings a 
year. 

Ask for an Independent Review. Periodically, citizens 
should insist that their school district be examined by 
independent experts. Too often reviews are undertaken 
by agencies concerned with irrelevant criteria, by col- 
leagues reluctant to be candid, or by friends with some- 
thing to lose if the review is unfavorable — political 
support from the district, for example, or future com- 
mercial benefits. 

Barriers and Ways to Overcome Them 

No discussion of citizen efforts to improve the quality 
of curriculum management would be complete without 
acknowledging the chief obstacles and mentioning tac- 
tics for circumventing them. 

In/brmation Overload. When citizens begin asking prob- 
ing questions, they may find themselves swamped with 
documents, studies, reports, position papers, etc. Even 
some school board members complain that this 
strategem appears to be used by some school adminis- 
trators to dissuade them from poking about the school 
system. 

Few laypersons relish the job of studying stacks of re- 
ports filled with footnotes and professional jargon. Citi- 
zens (and board members) should ask for summaries that 
explain the documents, indicate significance, and tell 
how they have been used by the administration. 

Fear of Being Labeled Malcontents. Citizens are some- 
times afraid to question their school districts for fear of 
being called malcontents. If there is no specific curricular 
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issue facing the community, it can be difficult to explain 
the need for reviewing curriculum managoment. 

Citizens should not be put off by their apprehensions. 
Improvements in school district management sometimes 
require intense prodding from outside the circle of 
school officials. Broadly based inquiry into school 
management can avoid the emotions of single-issue con- 
troversies and gradually attract beneficial press atten- 
tion. In short, citizens should work to develop a climate 
that encourage^ constructive responses to their queries 
about curriculum, instruction, and learning. 

De/ensiveness by Officialdom. When citizens request in- 
formation, they may encounter resistance and defen- 
siveness. Officials in school systems with chronic prob- 
lems may develop a siege mentality. To them, every 
question may portend a battle and thus evoke not a 
straightforward answer but an elaborate defense against 
a presumed accusation. 

If citizens are thought to be witchhunting rather than 
voicing legitimate concerns, they can expect not only a 
battle but very likely the creation of opposing pressure 
groups in the community. To avoid this problem, citi- 
zens should be candid about their motives. When trust 
permits a lowering of defenses, citizens may be sur- 
prised to discover allies within the school system. No 
single faction has a monopoly on the desire to help chil- 
dren learn. 

A Desire for Rapid Solutions. Citizens not familiar with 
the intricacies of school district operations may be at- 
tracted to simplistic solutions that sound all right but 
cannot possibly work. The appeal of quick and simple 
remedies is that they appear to reduce the necessity of 
prolonged diagnosis. Worse, such ideas enable the op* 
ponents of reform to deal only with the proposed poor 
solution instead of forcing a careful examination of the 
problem. Typical response to a simplistic suggestion is, 
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"We are already doing that," or, 4, We tried that and it 
didn't work." 

Citizens can steer clear of such impasses by refusing 
to embrace seemingly quick and easy solutions. First 
they must talk with school officials to learn their views 
of the problem, what solutions they tried, the factors 
they considered, and the reason officials chose the pol- 
icy or practice being questioned. This approach will 
help show that the questioners are judicious and delib- 
erate, rather than thoughtless and impetuous in their ef- 
forts to bring about change. 

Impatience and Limited Time, Impatience is the enemy 
of meaningful change because it works to the advantage 
of the opponents of change. The school system is there. 
It will probably be there next year. Citizens must be 
methodical, patient, and persistent in obtaining the an- 
swers they seek. 

Sometimes citizens can prevent a premature conclu- 
sion by asking school officials to postpone a decision 
and allow more time for thoughtful community discus- 
sion. This request cannot be rejected easily except in ex- 
treme emergencies. Few school administrators or boards 
want to run roughshod over community opinion. Citi- 
zens usually find that reasonable requests — especially 
those that are reported in the local press — are re- 
spected, 

IV. Summing Up 

Curriculum is not the only element of schooling that 
affects what children learn, but it is a major element that 
can be directly managed to improve gradually pupil 
achievement. Citizens who understand the principles of 
an educational performance audit and who cause audits 
to become a regular part of school district evaluation 
will greatly improve curriculum management and thus 
student learning in their district. But the true test of an 
educational performance audit is putting the results to 
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work. An EPA can give citizens the knowledge needed 
to ensure that curriculum is firmly directed toward a 
school district's most important goal — the students' 
learning. 
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